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(57) ABSTRACT 

An image processing system including a correction pattern 
storing unit for storing correction patterns set corresponding 
to kinds of color fogs, a correction pattern selecting unit for 
selecting a correction pattern suitable for correction of input 
image, a correction amount storing unit for storing a cor- 
rection amount indicative of an appropriate degree of cor- 
rection on color fog, a tone curve generating unit for 
generating a tone curve of RGB based on a selected correc- 
tion pattern and a correction amount stored in the correction 
amount storing unit, and an LUT converting unit for per- 
forming table conversion on image data of input image 
according to a generated tone curve to conduct color con- 
version processing of all the pixels of image data. 
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FIG. 6 
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FIG. 14 ( PRIOR ART) 



1400 



INPUT IMAGE 
BUFFER 



1401 



COLOR 
CORRECTION 
UNIT 



1404 



OUTPUT IMAGE 
BUFFER 



1402 



SPECTRAL 
PROPERTIES 
STORING 
UNIT 



1403 



CORRECTION 

AMOUNT 
RETRIEVING 
UNIT 



1502 
1501 C 1503 



FIG. 15 



1507 
1506 5 



DIAPHRAGM 
CONTROL 
UNIT 



FULL SCREEN 
MEAN VALUE 
DETECTING 
UNIT 



1510 



TARGET 
BRIGHTNESS 
CALCULATING 
UNIT 



(PRIOR ART) 
^1504 



AMPLIFIER 



SMALLER REGION 

MEAN VALUE 
DETECTING UNIT 



LOW BRIGHTNESS 
MEAN VALUE 
CALCULATING 
UNIT 



1505 



A. 



SIGNAL 
PROCESSING 
CIRCUIT 



^V/1508 



1509 



BACKUGHT 
DEGREE 
CALCULATING 
UNIT 



/A/ 



1511 



04/13/2004, EAST Version: 1.4.1 



U.S. Patent Feb. 12, 2002 Sheet 14 of 14 US 6,346,994 Bl 



FIG. 16 ( PRIOR ART) 
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IMAGE PROCESSING SYSTEM AND ITS been caused by such factors as film, lens, and exposure 

SMOOTHING METHOD FOR CORRECTING characteristics, along with color variances among different 

COLOR FOG AND BACKLIGHT OF A light sources, is impossible to correct solely based on the 

DIGITAL IMAGE properties of different light sources, making this method 

5 inadequate for obtaining good correction results. 

This application is a divisional of application Ser. No. Next, backlight correction is described. Conventional 

08/898,132, filed Jul. 22, 1997. backlight correcting systems include an automatic exposure 

control device, for example, a video camera. This type of 

BACKGROUND OF THE INVENTION system controls the diaphragm so as to maintain the level of 

1 Field of the Invention 10 out P ut s ^S na ^ s constant. Means of controlling the diaphragm 

include the mean value method that obtains the mean value 

The present invention relates to an image processmg 0 f brightness of an entire screen, the peak value method that 

system for processing digital image data and its image detects the maximum value of brightness of a screen, and the 

smoothing method, and more particularly, to an image method that combines botlh A dia ph r agrn control unit, 

processing system and its smoothing method characterized }5 typically located ^hind a lens system, controls the quantity 

by the means employed for correctmg an input image 0 f incident light to make the screen brighter or darker. This 

recorded in a color fog state and in a backlight state. type of conventional backligh t correcting system is 

2. Description of the Related Art disclosed, for example, in Japanese Patent Laid-Open Pub- 

When processing digital image data by use of a computer- lication No. 6-46325, "^Automatic Exposure Control Sys- 

based image processing system, various forms of smoothing 20 tern". The same publication describes a system that esti- 

are performed on the image data as necessary. Hereafter, mates the intensity of backlight based on the brightness data 

color fog and backlight correction by use of a conventional for a screen and determines how much the diaphragm should 

image processing systems is described. be controlled using the value thus obtained. 

First, color fog correction is described. In the color fog The conventional backlight correction device disclosed in 
correcting method used by conventional image processing 25 lne same publication is described with reference to FIG. 15. 
systems, the tone curve of the RGB is interactively modified; la ^G. 15, a subject image is formed on an image pickup 
the operator corrects the colors of an image while confirm- device 1503 via a lens 1501 and a diaphragm 1502, con- 
ing the results of his operation verted into an electric signal, and output through a signal 
This conventional method focusing on smoothing the tone Process ing circuit 1505 for performing the y processing and 
curve of the RGB interactively, however, requires too many 30 ° ther tasl f At . ^ ^ th * ^^phragm control is performed 
adjustment parameters for the operator to perform smooth- ^ of a from the ima S e P lcku P device 1503 as 
ing intuitively, thereby giving rise to a drawback of longer ° A 0 ^; , . . . _ , 
operation time. Furthermore, this method requires experi- Ml screen mean value detecting unit 1507 detects the 
ence and skill so that those having no or little experience are m ^ brl S h,n f of full screen. Subsequently, the dia- 
unable to perform smoothing as desired. 35 co ° lro1 unlt 1506 determines the diaphragm aperture 
_ . , ... . ,. so as to achieve a target brightness. A smaller region mean 
This type of conventional image processing system for yame detecti ^ 15Q8 diyides a mtQ 

smoothing color is disclosed for example in Japanese ions md calculates the mean value of each 51ock . A low 

Patent Uid-Open Publication No. 2-94893, -Image Pro- bri htness mean value ca i cu i ating unit i 509 arranges in the 

cessmg System . The same publication describes a system 40 order of brightness the mean values of brightness of respec- 

which allows correction depending on the spectral properties tive small re ^ 0QS calculated b the smaller ion mean 

of different types of light source. value detecting unit 1508 , and selects a predetermined 

The conventional image processing system disclosed in number of small regions sequentially from the small region 

the same publication is described with reference to FIG. 14. 0 f the lowest brightness, and calculates the mean brightness 

In FIG. 14, a spectral properties storing means 1402 stores 45 of the regions thus selected. A backlight degree calculating 

the amounts of correction to be made for three color un j t 1511 calculates the degree of backlight from the mean 

components, i.e., red, green, and blue, depending on the brightness of the several selected regions calculated by the 

spectral properties of different types of light source. A i ow brightness mean value calculating unit 1509. A target 

correction amount retrieving means 1403 retrieves the brightness calculating unit 1510 modifies the target aperture 

amount of correction for a specified light source from the 50 so as to enlarge the diaphragm aperture when the degree of 

spectral properties storing means 1402 and inputs it into a the backlight calculated by the backlight degree calculating 

color correcting means 1401. The data stored in an input unit 1511 becomes larger, and modifies the target aperture so 

image buffer 1400 is subjected to color correction by the as to re duce the diaphragm aperture when the degree of the 

color correcting means 1401 and output to an output image backlight becomes smaller. 

buffer 1404. Assuming that the input pixel values are R, G, 55 i n conventional backlight correcting systems, backlight is 

and B, and that the output pixel values are R\ G', and B\ corrected by adjusting the diaphragm aperture so as to enter 

color correction is performed using the following expression the greater quantity of light or the smaller quantity of light. 

(1). This aims to control the device, a video camera or the like, 

R'=RfrO G'-G/gO B'=B/bo (1) directly. The similar correcting method cannot be used for 

60 the data once quantized and stored as a digital image. 
This correcting method multiplies the RGB value by the Considering diaphragm control as image processing, y 
constant term. correction conversion as illustrated in FIG. 16 is the closest 
In the correcting method that simply multiplies the RGB conversion to backlight correction through the above- 
values by the constant term, however, it is impossible to mentioned modification of the diaphragm aperture. When 
smooth all the colors of respective light sources completely, 65 diaphragm is not changed, the input value of brightness is 
resulting in the inability to achieve the best possible color the same as the output value of brightness, as illustrated in 
through correction. In addition, a color fog state that has the conversion characteristic 1603. An enlarged diaphragm 
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aperture has characteristic as illustrated in the conversion tone curve generating means for generating a tone curve 

characteristic 1601 for a large aperture and a reduced of RGB based on the correction pattern selected by the 

diaphragm aperture has the characteristic as illustrated in the correction pattern selecting means and the correction 

conversion characteristic 1602 for a small aperture. amount stored in the correction amount storing means, and 

Since the range of partial light quantities in the scenery of 5 LUT converting means for performing table conversion 

the natural environment is being recorded by a video on image data of the input image based on the tone curve 

camera, the brightness value in the shadow region (the generated by the tone curve generating means to conduct 

darkest region in the image) will not be increased uniformly color conversion processing of all the pixels of the image 

when the diaphragm is enlarged; instead, more information data. 

on the shadow region is recorded as contrast intensifies. In 10 The image processing system may further comprise cor- 

the case of image data, however, since brightness inform a- rection amount specifying means for specifying a correction 

tion on the shadow region has already been quantized and amount to be stored in the correction amount storing means 

compressed, y correction would not increase the brightness according to each correction processing by the operation of 

information on the shadow region. In other words, the an operator. 

shadow region becomes brighter uniformly to an excessive 15 The tone curve generating means may comprise 

level. highlight control amount calculating means for calculat- 

In a video camera, the value of the quantity of light in the ing a control amount of a highlight region in each compo- 

backlight portion is always near "0". In an image data input nent of RGB based on the correction pattern and the cor- 

from a color photographic film through a scanner, the value rection amount, 

of the light quantity in the backlight portion does not always 2Q half tone control amount calculating means for calculating 

represent the pixel value near "0". For a photography printed a control amount of a half tone region in each component of 

with the backlight portion slightly brighter, the backlight RGB based on the correction pattern and the correction 

portion is in the vicinity of, for example, the pixel value amount, 

"30". With reference to FIG. 16, an input backlight unit 1604 shadow control amount calculating means for calculating 

corresponds to the backlight portion. Through the y correc- 25 a control amount of a shadow region in each component of 

tion for the image data, the brightness value of the backlight RGB based on the correction pattern and the correction 

portion is converted into an output backlight portion 1605. amount 

As illustrated in FIG. 16, the range of the output backlight tone ' curve calculating means for calculating the tone 

portion 1605 in this case is narrower than the range of the curve of each of RGB based on the mree ldods 

input backlight portion 1604. In other words, although the 3Q of comrol amounts calculated by the three kinds of control 

backlight portion in the image becomes brighter, the range amount calculating meanSj 

of the brightness becomes narrower, thereby deteriorating ( . , , c . 4 . , 

A « A *7 ,.. , ' . * A . A & a straight line generating module for use in the tone curve 

the contrast condition and consequently he image quality. calculati processing by tone curve ca i culating means 

The convenuonal backlight correction technique for dig,- tQ conduc f s £ ai ht lir f e ir f terpolatioD be[ween a ^Joi point 

tal image data, although it simulates the diaphragm control « . , . u . . £ . , t , ■ * ■ i 

u *u u c it. j * . ii 35 m a togh brightness region and a control point in a low 

by a camera through the y correction for the data, is actually brightness re ion and 

incapable of performing a good backlight correction in the . , 

correction of the digital data. , a S eneratul S means "» «« * J* tone curve 

calculating processing by the tone curve calculating means 

SUMMARY OF THE INVENTION to conduct curve interpolation for smoothly interpolating 

One objective of the present invention is to provide an 40 between a control point in a half tone region and starting 

image processing system capable of easily executing such points on the high brightness side and the low brightness 

complicated correction operations as correction according to s ^e. 

the light source colors and correction of a snowy scenery. According to the second aspect of the invention, digital 

Another objective of the present invention is to provide an image data correcting method in an image processing system 

image processing system capable of reducing time required 45 which conducts necessary correction processing on digital 

for operation and consequently reducing manhours through image data, comprises the steps of 

increased efficiency as well as allowing any operator to among correction patterns set corresponding to kinds of 

obtain desired correction results, regardless of the level of color fogs, selecting the correction pattern suitable for 

skill and experience. correction of input image by the operation of an operator, 

One more objective of the present invention is to provide obtaining a correction amount indicative of an appropriate 

an image processing system capable of correcting backlight degree of correction on color fog, 

without decreasing the contrast by giving the characteristic generating a tone curve of RGB based on the correction 

of correction to a greater brightness the medial pixels pattern selected at the correction pattern selecting step and 

brighter than the shadow region. 55 the correction amount obtained at the correction amount 

According to the first aspect of the invention, an image obtaining step, and 

processing system which conducts necessary correction pro- performing table conversion on image data of the input 

cessing on digital image data, comprises image according to the tone curve generated at the tone 

correction pattern storing means for storing correction curve generating step to conduct color conversion of all 

patterns set corresponding to kinds of color fogs, 60 pix^s °f tne image data. 

correction pattern selecting means for selecting the cor- The tone curve generating step comprises the steps of 

rection pattern suitable for correction of input image among calculating a control amount of a highlight region in each 

the correction patterns stored in the correction pattern stor- component of RGB based on the correction pattern and the 

ing means through the operation of an operator, correction amount, 

correction amount storing means for storing a correction 65 calculating a control amount of a half tone region in each 

amount indicative of an appropriate degree of correction on component of RGB based on the correction pattern and the 

color fog, correction amount, 
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calculating a control amount of a shadow region in each extract a shadow region brightness value of a desired low 

component of RGB based on the correction pattern and the brightness pixel. 

correction amount, and The backlight correction table generating means may 

calculating the tone curve of each component of RGB comprise 

based on the three kinds of control amounts calculated at 5 parameter calculating means for calculating a parameter 

each the steps, wherein for use in correction based on the backlight correction 

at the time of calculating a tone curve, the tone curve amount stored in the backlight correction amount storing 

calculating step performing means, 

a straight line generating module for conducting straight first conversion table generating means for generating a 

line interpolation between a control point in a high bright- conversion table by using the parameter calculated by the 

ness region and a control point in a low brightness region, parameter calculating means, and 

and second conversion table generating means for generating 

a curve generating module for conducting curve interpo- tne backlight correction table based on the conversion table 

lation for smoothly interpolating between a control point in 15 generated by the first conversion table generating means and 

a half tone region and starting points on the high brightness me shadow region brightness value extracted by the shadow 

side and on the low brightness side. region brightness value extracting means, 

According to the third aspect of the invention, a computer the parameter calculating means calculating spline control 

readable memory which stores an image processing program P oint coordinates based on the backlight correction amount, 

for controlling an image processing system which conducts 20 an ^ 

necessary correction processing on digital image data, the the first conversion table generating means calculating a 

image processing program comprises the steps of spline curve based on the spline control point coordinates. 

among correction patterns set corresponding to kinds of Th e backlight correction table generating means may 

color fogs, selecting the correction pattern suitable for comprise 

correction of input image by the operation of an operator, 25 parameter calculating means for calculating a parameter 

obtaining a correction amount indicative of an appropriate for use "> correction based on the backlight correction 

degree of correction on color fog, amount stored in the backlight correction amount storing 

means 

generating a tone curve of RGB based on the correction „ ' . . , . * 

pattern selected at the correction pattern selecting step and w first conversion table generating means for generating a 

the correction amount obtained at the correction amount 30 ^^'Sion table by using the parameter calculated by the 

obtaining step, and parameter calculating means, and 

_r . „ U1 . . j « r *i_ ■ * second conversion table generating means for generating 

performing table conversion on image data of the input . . 7 . ■. ■ . 

. j* . ,i , + j * #u * the backlight correction table based on the conversion table 

image according to the tone curve generated at the tone ,° Al _ - A • , , • , 

. . ^.i * c u generated by the first conversion table generating means and 

curve generating step to conduct color conversion of all « ° , , J . , . , , ^ . ■, . . 

, °- 4 . . ° J , JJ the shadow region brightness value extracted by the shadow 

pixels of the image data , . , * i . 

r ° region brightness value extracting means, 

According to the fourth aspect of the invention, an image , „ , ,^ • f . i ma „ , 

to t • , * • the second conversion table generating means may 

processing system which conducts necessary correction pro- include 

cessing on digital image data, comprises , « - . , , . 4 . , . A . c 

° ° o » r backlight correction charactenstics calculating means for 

shadow region brightness value extracting means for 40 calculating> with reference to a brightness value of a pixel in 

extracting a shadow region brightness value which is a ^ data of ioput ^ the shadow regioQ brightness 

brightness value of a low brightness pixel from image data valuC) aod the convers i 0 n table generated by the first con- 

of input image, version table generating means, a brightness value of the 

backlight correction amount storing means for storing a pixel obtained after backlight correction, and 

backlight correction amount indicative of an appropriate 45 brightness value comparing means for comparing a 

degree of correction on backlight input image, brightness value of each pixel in image data of input image 

backlight correction table generating means for generat- with the shadow region brightness value, and when the 

ing a backlight correction table characterized by, based on brightness value of the target pixel is lower than the shadow 

the shadow region brightness value extracted by the shadow 5Q region brightness value, taking the brightness value of the 

region brightness value extracting means and the backlight target pixel as a brightness value to be obtained after the 

correction amount stored in the backlight correction amount correction and when the brightness value of the target pixel 

storing means, not correcting a pixel whose brightness value is higher than the shadow region brightness value, activating 

falls in the range between "0" and the shadow region the backlight correction characteristics calculating means to 

brightness value and correcting a pixel whose brightness 55 calculate a brightness value to be obtained after the correc- 

value is higher than the shadow region brightness value so tion. 

as to increase the brightness value, and According to the fifth aspect of the invention, a digital 

LUT converting means for performing table conversion image data correcting method in an image processing system 

on image data of the input image based on the backlight which conducts necessary correction processing on digital 

correction table generated by the backlight correction table 60 image data, comprises the steps of 

generating means to conduct color conversion processing of extracting a shadow region brightness value which is a 

all pixels of the image data. brightness value of a low brightness pixel from image data 

The image processing system may further comprise RGB °f m P ut image, 

brightness value converting means for calculating, from an obtaining a backlight correction amount indicative of an 

RGB value of a pixel, a brightness value of the pixel, 65 appropriate degree of correction on backlight input image, 

wherein the shadow region brightness value extracting generating a backlight correction table characterized by, 

means causes the RGB brightness value converting means to based on the shadow region brightness value extracted at the 
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shadow region brightness value extracting step and the BRIEF DESCRIPTION OF THE DRAWINGS 

backlight correction amount obtained at the backlight cor- ^ invention wiu ^ underetood more m from 

rection amount obtaimng step, not correcting a pixel whose ^ detai , ed descri iven herebelow and from the 

brightness value falls ,n the range between "0> and the accompanying draw £ ngs 0 f the preferred embodiment of the 

shadow region brightness value and correcting a pixel whose 5 inveDti which ho shou , d ^ be ^ , o ^ ^ 

brightness value is higher than the shadow region brightness ^ , Q ^ invemi but are for explanation and under . 

value so as to increase the brightness value, and standing only 

performing table conversion on image data of the input j n ^ d ra win S' 

image based on the backlight correction table generated at _ ¥ _ . . . 

the backlight correction table generating step to conduct 10 . 1 15 a block ^™ in % a constitution of an 

color conversion processing of all the pixels of the image ^ Processing system according to an embodiment of the 

( j ata present invention. 

The backlight correction table generating step comprises FIG. 2 is a block diagram showing a constitution of a tone 

the steps of curve 8 eneratm S umt °f tne present embodiment. 

calculating a parameter for use in correction based on the 15 FIG ; 3 * a flow chart sho ™ n f a flow of the Processing in 
backlight correction amount stored in the backlight correc- the color fo S correctmg method of the embodiment, 
tion amount storing means, FIG * 4 is a schematic view for use in describing genera- 
generating a conversion table by using the parameter l ™ Passing of a color fog correction table according to 
calculated at the parameter calculating step, and the embodiment - 

generating the backlight correction table based on the FIG ' 5 view sh ™ in S adata exam P le of a co ^ection 

conversion table generated at the conversion table generat- P attern stonn S umt of the embodiment, 

ing step and the shadow region brightness value extracted by FIG - 6 is a schematic view showing a constitution 

the shadow region brightness value extracting means, example of a correction parameter specifying device for use 

the step of generating a backlight correction table based 25 ^ the embodiment, 

on the conversion table include the steps of FIG * 7 is a block diagram showing a constitution of an 

comparing a brightness value of each pixel in image data Pressing system according to another embodiment 

of input image with the shadow region brightness value, of the P resent inventlon * 

determining a brightness value of the target pixel as a FIG ; 8 is a block diagram showing a constitution of a 

brightness value to be obtained after the correction when the 30 second conversion table generating unit of the embodiment, 

brightness value of the target pixel is lower than the shadow FIG - 9 ^ an illustration for use in describing a y correction 

region brightness value, and curve obtained by the control point. 

calculating a brightness value of a target pixel to be FIG * 10 is a flow chart showing a flow of the processing 

obtained after the backlight correction with reference to the in a backlight correction method according to the embodi- 

brightness value of the target pixel, the shadow region 35 nient. 

brightness value, and the conversion table generated at the FIG. 11 is a schematic view for use in describing the 

conversion table generating step when the brightness value processing for generating a backlight correction table from 

of the target pixel is higher than the shadow region bright- a first conversion table according to the embodiment, 

ness value. FIG. 12 is an illustration for use in describing a conver- 

According to the sixth aspect of the invention, a computer 40 sion characteristic of the backlight correction table gener- 

readable memory which stores an image processing program a *ed by the embodiment. 

for controlling an image processing system which conducts FIG. 13 is a view showing an example of a look-up table, 

necessary correction processing on digital image data, the FIG. 14 is a block diagram showing a constitution of the 

image processing program comprises the steps of ^ conventional image processing system for correcting the 

extracting a shadow region brightness value which is a color fog of an image, 

brightness value of a low brightness pixel from image data FIG . 15 is a block diagram showing a constitution of the 

of input image, conventional image processing system for performing the 

obtaining a backlight correction amount indicative of an backlight correction of an image, 

appropriate degree of correction on backlight input image, 50 FIG. 16 is a view for use in describing a conversion 

generating a backlight correction table characterized by, characteristic according to a y correction, 
based on the shadow region brightness value extracted at the 

shadow region brightness value extracting step and the DESCRIPTION OF THE PREFERRED 

backlight correction amount obtained at the backlight cor- EMBODIMENT 

rection amount obtaining step, not correcting a pixel whose 55 The preferred embodiment of the present invention will 

brightness value falls in the range between "0" and the be discussed hereinafter in detail with reference to the 

shadow region brightness value and correcting a pixel whose accompanying drawings. In the following description, 

brightness value is higher than the shadow region brightness numerous specific details are set forth in order to provide a 

value so as to increase the brightness value, and thorough understanding of the present invention. It will be 

performing table conversion on image data of the input 60 obvious, however, to those skilled in the art that the present 

image based on the backlight correction table generated at invention may be practiced without these specific details. In 

the backlight correction table generating step to conduct other instance, well-known structures are not shown in detail 

color conversion processing of all the pixels of the image in order to unnecessarily obscure the present invention, 

data. A principal of color fog correction in an image, according 

Other objects, features and advantages of the present 65 to the present invention, is described first, 

invention will become clear from the detailed description With reference to FIG. 3 showing a flow of the processing 

given herebelow. in correction of color fog of an image according to the 
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present invention, the operator first confirms an input image With reference to FIG. 1, the image processing system of 

by a monitor or the like, and selects one pattern to be the embodiment includes an input image buffer 10 for 

executed from the correction patterns prepared beforehand holding input image data, a correction pattern storing unit 20 

(Step 301). for storing correction patterns for correcting color fog in an 

There are several patterns in the unfavorable color con- 5 input image, a correction pattern specifying unit 30 for an 

dition of an image, including green fog in a fluorescent light, operator to specify the correction pattern, a correction 

yellow fog in an electric light, red fog in a snow scene, and amount storing unit 40 for storing the correction amount of 

blue fog by light coming through a window facing north. color fog, a correction amount specifying unit 50 for an 

These are caused not only by the type of the light source but operator to specify the correction amount, a tone curve 

also by the characteristics of the photographic film used and 1Q generating unit 60 for generating the tone curve data of RGB 

the CCD, The present invention holds tone curve control on the basis of the data stored in the correction pattern 

parameters for each of these unfavorable patterns. Correc- storing unit 20 and the correction amount stored in the 

tion pattern selected in Step 301 means the combination of correction amount storing unit 40, an LUT storage buffer 70 

these control parameters. f or storing the generated tone curve data, an LUT converting 

Next, the operator determines the extent of correction by unit 80 for performing a table conversion on the image data, 

specifying the amount of correction (Step 302). After a and an output image buffer 90 for holding output data. FIG. 

control parameter for the same correction pattern is obtained 1 snows the characteristic components of the embodiment 

(Step 303), the RGB tone curve is calculated on the basis of on i Vj and the 0 ther general components are not shown 

the control parameter and the correction amount (Step 304), therein It ^ nee dless to say that the system includes further 

and color conversion processing on an input image data on components for executing other smoothing operations, 

the basis of the tone curve data thus obtained is performed 20 ^ding backlight correction to be described herein later, 

(5>tep 3U5). anc j omer components for executing other processing. 

FIG. 5 shows an example of the correction pattern men- FIG. 2 is a block diagram showing a constitution of a tone 
tioned above. In a data table 501 for correction patterns as curve geaerating unit 60 . As illustrated in FIG. 2, the tone 
illustrated, each item of the unfavorable pattern such as curve generating unit 60 includes a highlight correction 
green fog in a fluorescent light and its corresponding tone amount ca i cu lating unit 61 for calculating the correction 
curve control parameter 502 for correcting the unfavorable amount irj each highlight reg i 0 n of the RGB on the basis of 
condition are registered. The tone curve control parameter the data stored m the correction pattern storing ^ 20 and 
502 mcludes data on highlight (hi), half tone (m), shadow tne correction amount store d in the correction amount stor- 
ed), as illustrated in FIG. 5 Each piece of data has three ing unit 40 a half tone correction amount calculating uni t 62 
RGB control parameters 503. For example, "hi" is repre- for calculating the correction amount of each half tone 
sented by the combination of (Rh, Gh, Bh). region of the RGB> a shadow correction amount ca icui at i ng 

An example of tone curve control by the use of highlight, un { { 53 for calculating the correction amount of each shadow 
half tone, and shadow as parameters is described with reg i on Q f RGB, a tone curve data calculating unit 66 for 
reference to FIG. 4. A tone curve is controlled by the 35 calculating the tone curve data on the basis of the above- 
specified correction amount (grad) and parameters (hi), (m), mentioned three correction amounts, a straight line gener- 
(sd). 

ating module 64, and a curve generating module 65. 

In the example shown in FIG. 4, the M control point 404 In tnus constituted image processing system, the operator 

is controlled by the data of half tone (m) and (grad), and used nrst se i ects a correction pattern to be adopted to an image of 

for generating a half tone correction curve 401. The HL 4Q the input image buffer 10 by the correction pattern specify- 

control point 406 is controlled by the data of the highlight mg urJ i t 30, an d inputs an appropriate color fog correction 

(hi) and (grad) and the SD control point 405 is controlled by amount into the correction amount storing unit 40 by use of 

the data of the shadow (sd) and (grad). The HL control point t he correction amount specifying unit 50. As for the color 

406 and the SD control point 405 are used to generate a f og correction amount, a predetermined value may be held 

highlight shadow correction curve 402. 45 m tne correction amount storing unit 40 beforehand. 

In the half tone correction curve 401, the M control point correction pattern specifying unit 30 includes, for 

404 on the tone curve moves upward when the correction example, a monitor for displaying an image, and an interface 

amount of the half tone is "+", and it moves downward when for selecting the correction pattern with a mouse or other 

it is An interpolation curve interpolates smoothly pointing device. FIG. 6 shows a constitutional example for 

between the starting point (0,0) of the tone curve on the side 50 realizing the correction pattern specifying unit 30 and the 

of low brightness, the M control point 404, and the starting correction amount specifying unit 50. The correction pattern 

point (255, 255) of the tone curve on the side of high specifying means 601 displayed on the CRT monitor 604 

brightness, thereby generating a tone curve. shows the items such ^ &GGn fog ^ a fluorescent light, 

In the highlight shadow correction curve 402, when the yellow fog in an electric light, red fog in a snow scene, and 

highlight correction amount and the shadow correction 5S blue fog in a light from a window facing north. The operator 

amount are "+" or the HL control point 406 and the SD specifies a desired correction pattern by operating a mouse 

control point 405 move as illustrated. A straight line inter- 603. The correction amount specifying means 602 also 

polates between the HL control point 406 and the SD control displayed on the CRT monitor 604 shows a slider bar for 

point 405. specifying the extent of correction. The operator specifies a 

As a result, the half tone correction curve 401 is synthe- 60 desired correction amount by operating the mouse 603. 

sized with the highlight shadow correction curve 402, gen- The tone curve generating unit 60 obtains the tone curve 

erating a synthetic curve 403. The above-mentioned pro- data of the corrected pattern specified by the operator 

cessing is performed on the tone curve of every RGB by use through the above mentioned correction pattern specifying 

of the RGB control parameter 503 illustrated in FIG. 5. unit 30, from correction pattern storing unit 20, and similarly 

FIG. 1 is a block diagram showing a constitution of an 65 further obtains the correction amount specified by the opera- 
image processing system for realizing the above-mentioned tor through the correction amount specifying unit 50, from 
color fog correction. the correction amount storing unit 40, thereby calculating 
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the tone curve data of the RGB by combining these data. The 
calculated tone curve data is supplied to the LUT storing 
buffer 70, 

Hereafter, the calculating processing of the tone curve 
data by the tone curve generating unit 60 is described in 
detail, using the case in which the data illustrated in FIG. 5 
are used as control parameters as an example. In this 
description, it is assumed that the selection of a correction 
pattern (Step 301 in FIG. 3) and specification of the correc- 
tion amount (Step 302) have already been completed by the 
operator. 

The highlight correction amount calculating unit 61 first 
obtains the highlight control parameter hi as the control 
parameter from the correction pattern storing unit 20. The 
control parameter hi is held in the format of the RGB control 
parameter 503, and defined as (Rh, Gh, Bh) (Step 303). 
Next, the unit 61 obtains the correction amount (grad) from 
the correction amount storing unit 40. The highlight correc- 
tion amount is calculated on the basis of the correction 
amount (grad) and the control parameter hi The highlight 
correction amount HL=(HLr,HLg,HLb) is obtained by the 
following expressions (2), (3), and (4). 



/ft/W?/ix(grad) 
HLg=Ghx( & zd) 
HLb=Bhx(gmd) 



(2) 
(3) 
(4) 



Similarly, the half tone correction amount calculating unit 
62 calculates the half tone correction amount. Assuming that 
the half tone parameter m is (Rm, Gm, Bm), the half tone 
correction amount M=(Mr, Mg, Mb) can be obtained by the 
following expressions (5), (6), and (7). 



Mr=Rmx(grad) 
A/g=Gmx(grad) 
Afb**Bmx(gmd) 



(5) 
(6) 
(7) 



The shadow correction amount calculating unit 63 calcu- 
lates the shadow correction amount. Assuming that the 
shadow parameter sd is (Rs, Gs, Bs), the shadow correction 
amount SD=(SDr, SDg, SDb) is obtained by the following 
expressions (8), (9), and (10). 



10 



15 



20 



25 



30 



35 



40 



45 



SDr^Rsx(grzd) 
SDg=Gsx(gmd) 
5Dfc«5sx(grad) 



(8) 
(9) 
(10) 



50 



That is to say, each correction amount per unit correction 
amount is written in the correction pattern storing unit 20, 
and the flexibility in correction is enhanced by multiplying 
the unit correction amount by the data stored in the correc- 
. tion amount storing unit 40 at each correction amount 
calculating unit. 

Next, the tone curve data calculating unit 66 calculates the 
tone curve data on the basis of the above-mentioned three 
correction amounts (Step 304). An example of the tone curve 
data calculation is illustrated in FIG. 4. Here, the RGB data 
are defined as 8 bits and the pixel value is defined as the 
value in the range of 0 to 255. The starting point of the tone 
curve on the side of low brightness is (0, 0), and the starting 
point of the tone curve on the side of high brightness is (255, 
255) 

First, the half tone correction curve 401 is calculated on 
the basis of the half tone correction amount M. The M 



55 



60 



65 



correction point 404 is the half point in the middle of the 
brightness of the tone curve. In the example of FIG. 4, the 
M control point 404 is defined as (128, 128). When the half 
tone correction amount M is "+", the M control point 404 
moves upward, and when it is it moves downward. 

An example of the movement of the M control point 404 
is described hereafter. Assuming that the R component of the 
half tone correction amount M is Mr, the M control point 
404 of the R tone curve moves from (128, 128) to (128, 
128+Mr). More specifically, when Mr=100, the M control 
point 404 on the R tone curve moves from (128, 128) to 
(128, 228). Similarly, the M control point 404 on the G tone 
curve and B tone curve moves respectively for each com- 
ponent of the correction amount. 

As a result, when the half tone correction amount is "+", 
the tone curve of each RGB component becomes a curve 
expanded upward as illustrated in the conversion character- 
istic 36. In the actual calculation, the curve generating 
module 65 is activated, to generate a curve by curve inter- 
polation such as spline interpolation or other interpolation 
for the point (0, 0), the M control point 404, and the point 
(255, 255). The only requirement here is that the starting 
points (0, 0) and the point (255, 255) on the tone curve and 
the M control point 404 are smoothly connected by the curve 
interpolation and any interpolation function can be used for 
the curve interpolation. 

Next, the highlight shadow correction curve 402 is cal- 
culated on the basis of the highlight correction amount HL 
and the shadow correction amount SD. The HL control point 
406 is the control point positioned on the higher brightness 
side of the tone curve. When the highlight correction amount 
HL is "+", it is assumed that the HL control point 406 moves 
from (255, 255) towards (0, 255). When the highlight 
correction amount HL is it is assumed that the HL 
control point 406 moves from (255, 255) towards (255, 0). 
The SD control point 405 is the control point positioned on 
the lower brightness side of the tone curve. When the 
shadow correction amount SD is "+", it is assumed that the 
SD control point 405 moves from (0, 0) towards (255, 0). 
When the shadow correction amount SD is it is 
assumed that the SD control point 405 moves from (0, 0) 
towards (0, 255). 

An example of the movement of the SD control point 405 
and the HL control point 406 is described hereafter. Assum- 
ing that the R component of the shadow correction amount 
SD is SDr, when SDr>0, the SD control point 405 on the R 
tone curve moves from (0, 0) to (SDr, 0). When SDr<0, the 
SD control point 405 on the R tone curve moves from (0, 0) 
to (0, -SDr). Assuming that the R component of the high- 
light correction amount HL is HLr, when HLr>0, the HL 
control point 406 on the R tone curve moves from (255, 255) 
to (255-HLr, 255). When HLr<0, the HL control point 406 
on the R tone curve moves from (255, 255) to (255, 
255+HLr). The SD control point 405 and the HL control 
point 406 on the G tone curve and B tone curve are moved 
similarly. 

The straight line generating module 64 is activated to 
obtain a highlight/shadow correction curve 402 for the 
control points set as mentioned above by the straight line 
interpolation. 

The tone curve data calculating unit 66 then synthesizes 
the two tables generated as mentioned above. Assuming that 
the half tone correction curve 401 is stored in the Table A[ ], 
and the highlight/shadow correction curve 402 is stored in 
the Table B[ ], the synthesized curve 403 can be obtained 
using the following expression (11). 



^bIc[f>TableB[TablcA[iU(t=0, 1, 2, . . . 255) 



(11) 



04/13/2004, EAST Version: 1.4.1 



US 6,346,994 Bl 

13 14 

The conversion characteristic 409 is shown in FIG. 4 as Next, the operator specifies the backlight correction 

an example of combined curve. The synthesized curve 403 amount (Step 1002). The half tone correction parameter is 

is calculated separately for each RGB. The synthesized calculated from the specified backlight correction amount 

curve 403 obtained by calculation is output to the LUT (Step 1003) Examples of the half tone co ntrol parameters 

storing buffer 70 as the tone curve data for RGB. 5 indude the yalues ^ Q j ^ 0Q the lme curve 

After the table of the tone curve data thus created is stored *i» *■ / i u / j • *u 

in the LUT storing buffer 70, the LUT conversion unit 80 Alternatively, an appropriate value may be stored in the 

reads the RGB image data sequentially from the input image s y stem m adv ance as the backlight correction amount and 

buffer 10, and performs the conversion on the data of each use 11 when calculating the half tone correction parameter, 

component of the RGB with reference to the table of the 1Q Next, the half tone parameter thus calculated is used to 

corresponding component stored in the LUT storing buffer generate the first conversion table for use in correcting 

70 (Step 305). The values of the data after the table con- backlight (Step 1004). Here, the first conversion table is 

version are stored in the output image buffer 90. described. FIG. 11 shows an example of the first conversion 

As described above, the color fog correction processing ^ ^ characteristic ^ of the first mrsion table ^ 
by the image processing system of the present invention , . _„ _ . , , 
enables complicated smoothing that has been difficult so far, 15 shown in FIG. 11 is a Y correction curve that uses the y value 
such as smoothing according to the light source color and as the hdf tone P^meler, and » expressed by the following 
smoothing in a snow scene, by preparing the correction expression, 
patterns in accordance with the various unfavorable condi- 
tions of an image and performing data correction by table Y-cxV (13) 
conversion. 20 

Further, it can perform correction for the color fog caused characteristic curve has a conversion characteristic 

by not only color variances of the light source but also the mat increases the brightness in the half tone region. The 

film sensitivity and the exposure processing, by registering coefficient c is a constant that is determined by the range of 

proper correction patterns. brightness to be input. Since backlight correction requires an 

Color fog correction by the image processing system of 25 increase in the value of the brightness in the half region, the 

the present invention adopts such an intuitive specifying y value here is always less than "1.0". 

method that proper smoothing can be made by only speci- ^ example 0 f the me thods of converting a backlight 

fying a correction pattern and a correction amount, not correction amount G to the y value requires to prepare a table 

requiring many adjustment parameters As a result, the that shows ^^0^^ between backlight correction 

operation s time requirements are reduced, thereby enhanc- am0UQt Q and yalue tQ be ^ fof conversioiL 

ing efficiency and reducing operator manhours. In addition, k fa tQ calculate ^ va]ue {n such a manQer ^ an 

the system provides the advantage that the operation does • . L • 1 . 1 v *t i« 1 * 

t . , .„ j • *u 11 • appropriate brightness value X of half tone can be converted 

not require skill and experience, thus allowing even a . . • , , ^ «v , . , 

less-experienced operator to perform smoothing as desired. int0 a tightness va * ue (X+G) through the conversion pro- 
Next, the principle of the backlight correction according 35 cessin S- M an exam P le > FIG 9 shows the ™™ that ^ 

to the present invention is described. obtained when the control point 60 has changed from A to 

With reference to FIG. 10 showing a flow of the process- B - If me half tone parameter represents n control points (xl, 

ing of the backlight correction according to the present x2, x3 . . . ) on the spline curve, a curve can be obtained by 

invention, the lower brightness portion is first extracted from performing spline interpolation on the respective control 

an input image on the screen and its brightness is stored as 40 points. 

the shadow brightness value (Step 1001). Next, a backlight correction table is generated by use of 

In order to extract the shadow brightness value, a histo- the shadow region brightness value extracted in Step 1001 

gram of the brightness is created. The brightness herein (Step 1005). FIG. 12 shows an example of backlight cor- 

means the numerical value showing the brightness of the rection table. According to the characteristic 1204 in the 

RGB pixel. One method of obtaining the brightness from the 45 backlight correction table, the input and output from the 

RGB value is to use the Y value of the CIE-XYZ value. brightness 0 to the shadow region brightness value 1203 are 

More specifically, assuming that the RGB value is the NTSC the same. The brightness increases gradually starting at the 

signal, the Y value can be obtained by the following expres- shadow region brightness value 1203, and the input and 

sion (12). output become the same again when the brightness is 

Y-0.299x/?+0.587xG+o. 114x5 (12) maximum. 

Additionally, such values of the average value of R, G, Following is an example of calculation to obtain the 

and B, or the maximum value of R, G, and B may be adopted characteristic 1204 of the backlight correction table. Assum- 

as the brightness Y of its pixel. m & that the characteristic of the first conversion table above 

A histogram is obtained by scanning the image data from 55 
the end and incrementing the value of the array hist[Y] at the 
brightness Y value. Alternatively, in order to shorten the 

processing time, a histogram may be created by searching f . . . „ , , , , 

for the pixels in appropriate intervals, for example, every the characteristic 1204 of the backhght correction table can 

severalpixels,insteadofsearchingforall.In reference to the 60 be ^pressed in the expressions (15) (16), and (17), as 

low brightness area of the created histogram, the pixel value follows * Here > b »f h ^ess value Y of an image is assumed 

of the low brightness pixel of the image is extracted and t0 be between 0 and 255 ' and ^ he ^tness ^ ^ 

defined as the brightness value of the shadow region. In conversion is represented by F(Y): 
addition, assuming, for example, that the number of pixels 

equaling a% of all the pixels is Na, the brightness value of 65 (When Y<Low) 
the pixel having the Na-th lowest brightness value may be 

adopted as the brightness value of the shadow region. ^00=^ (15) 



is: 

r-KY) (14) 
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(When y>Low) shadow region brightness value on the basis of the image 

data input into the input image buffer 110 (Step 1001 in FIG. 

_ (255 - Low) t ^ (16) 10). More specifically, a histogram for brightness data is 

255 x;te " + w created by converting the RGB data to brightness data by the 

255 (17) 5 ^® brightness value converting unit 120. Alternatively, a 

C(y)= (255 -Low) x{Y ~ Low ) histogram may be created by searching an image while 

obtaining every several pixels instead of searching for all the 
pixels, for faster histogram calculation. Next, from the 

As shown in FIG. 11, the characteristic 1102 of the histogram thus obtained, the brightness value of the pixel 

backlight correction table has a characteristic which is 10 having the lowest brightness in the image is extracted as the 

similar to the results that are obtained by mapping the shadow region brightness value. As described above, it is 

Y'=f(Y) curve, as shown by the characteristic 1101 of the also po^le that, by regarding the number of pixels equal- 

Jg s ™ rsi0n tabie ' 10 the range fr ° m (L ° W ' ^ t0 ing a% of all as Na, the pixel having the Na-th lowest 

(255,255). brightness value may be output as the shadow region bright- 

Generally speaking, since the input backlight portion 15 vame 

1201 is distributed in the vicinity of the shadow region A - n . • . . • . t . , ^ , ,■ , t 

brightness value, intensifying the contrast in this region MtGT the ^tion amoun is input into the backhght 

lea^ to an improvement in image quality. The character^tic ^ Ctl0 u n stonng umt 14 » b V the orator (Step 

1204 of the backlight correction table shown in FIG. 12 10 ? 2 > the backlight correction table generating unit 150 

indicates that the input backlight portion 1201 is converted calculates the backhght correction table using the extracted 

to the output backlight portion 1202, constantly intensifying 20 shadow region brightness value and the input backlight 

the contrast in the backlight portion. correction amount (Step 1003 to 1005), and inputs the 

Finally, the backlight correction table thus obtained is results into the LUT storing buffer 160. In the backlight 

stored as the lookup table (LUT 1300 shown in FIG. 13), correction table generating unit 150, the halftone correction 

which is then used for color-converting of all the pixel parameter calculating unit 152 first calculates the half tone 

values (Step 1006). 25 correction parameter using the backlight correction amount 

FIG. 7 is a block diagram showing a constitution of an (Step 1003). 

image processing system that implements the backlight When calculating the y value as the half tone parameter, 

correction as described above. the half tone parameter calculating unit 152 can store the 

With reference to FIG. 7, the image processing system of table showing correspondence between backlight correction 

the embodiment includes an input image buffer 110 for 30 amount G and y value in the memory beforehand as 

holding input image data, an RGB brightness value convert- described above, and refer to the table to determine the y 

ing unit 120 for calculating the brightness value from the yalue according t0 the k ut or otherwise calculate the y 

RGB value, a shadowy value b assumin such correction that will allow an 

130 for extracting the brightness value of the shadow region • ♦ u • u. i v ru i*. * u _* j 

r . u 1 1- u. *- . . • v appropriate brightness value X of half tone to be converted 

from an image, a backhght correction amount stormg umt „ t ri . u . • Ut , /v ^ , < t - iU 

140 for storing the backlight correction amount, a backlight 35 l ° *° value (X + G). When calculating the spline 

correction table generating unit 150 for generating a back- con * 01 P omts ***** Dal u f tone parameter this unit can store 

light correction table on the basis of the backlight correction m the memory beforehand the table showing correspon- 

amount and the shadow region brightness value, an LUT dence between backlight correction amount G and n control 

storing buffer 160 for storing the conversion table, an LUT points, and refer to the table to determine the control points 

converting unit 170 for performing lookup table conversion 40 according to the input. 

on an image, an output image buffer 190 for holding an The first table generating unit 153 generates a correction 

output image, and a noise removing filter 180. The backlight curve using the half tone parameter obtained by calculation, 

correction table generating unit 150 includes a half tone and stores it in the LUT storing buffer 160 (Step 1004). 

correction parameter calculating unit 152 for calculating the Similarly to the LUT 1300 as shown in FIG. 13, the LUT 

y value from the backhght correction amount as a half tone 45 storing buffer 160 can store data as the combinations of input 

correction parameter, a first conversion table generating unit brightness Y and output brightness F (Y). When the half tone 

153 for generating the first conversion table on the basis of parameter is the y value, a y correction curve is generated 

the y value thus calculated, and a second conversion table and stored in the LUT storing buffer 160. When the halftone 

generating unit 151 for generating the backlight correction parameter is the spline control points, a correction curve is 

table on the basis of the shadow region brightness value and 50 generated by performing spline interpolation using the con- 

the first conversion table. FIG. 7 shows the characteristic trol points and stored in the LUT storing buffer 160. 

components of the embodiment only, and the other general The second conversion table generating unit 151 gener- 

components are not shown therein. It is needless to say that ates a final backlight correction table using the shadow 

the system includes further components for executing other brightness value and the data of the correction curve stored 

smoothing operations, including color fog correction 55 in the LUT storing buffer 160 and stores it in the LUT 

described above, and other components for executing other storing buffer 160 (Step 106). 

processing. Next, generation of the backlight correction table by the 

FIG. 8 is a block diagram showing a constitution of the second conversion table generating unit 151 is described in 

second conversion table generating unit 151 of the backlight detail. 

correction table generating unit 150. As shown in FIG. 8, the 60 As described above, the second conversion table gener- 

second conversion table generating unit 151 includes a ating unit 151 includes a representative brightness generat- 

representative brightness generating unit 154, a shadow ing unit 154, a shadow pixel comparing unit 156, a backlight 

pixel comparing unit 156, a backlight correction character- correction characteristic calculating unit 155, a table writing 

istic calculating unit 155, a table referencing unit 157, and unit 158, and a table referencing unit 157. First, as the 

a table writing unit 158. 65 representative brightness to be stored in the LUT, the 

In thus constituted image processing system, the shadow representative generating unit 154 generates the brightness 

region brightness value extracting unit 130 extracts the value Y by incrementing by 1 from 0 until the maximum 
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value of brightness is reached. Then, the shadow pixel 
comparing unit 156 compares the brightness value Y and the 
shadow pixel value Low. When Y is smaller than Low, the 
table writing unit 158 stores the Y value as is at the 
predetermined address in the LUT storing buffer 160. When 
Y is greater than Low, the backlight correction characteristic 
calculating unit 155 calculates the value after backlight 
correction concerning Y and Low. 

The backlight correction characteristic calculating unit 
155 calculates the value after backlight correction on the 
basis of the brightness value Y and the shadow region 
brightness value Low, using the above-mentioned expres- 
sions (16) and (17). More specifically, first g(Y) is calculated 
using the expression (17), and next the brightness value F 
(Y) after backlight correction is calculated using the expres- 
sion (16). The expressions (17) and (18) can be obtained 
easily by combining a subtracting means, a multiplying 
means, and a dividing means. In this operation, f(Y) is 
referenced by the table referencing unit 157 and the LUT 
storing buffer 160. This f(Y) represents the result of con- 
version by the first conversion table conversion table that is 
already stored in the LUT storing buffer 160. 

F(Y) thus obtained as mentioned above is stored in the 
predetermined address in the LUT buffer 160 by the table 
writing unit 158. 

After the backlight correction table is stored in the LUT 
storing buffer 160, the LUT converting unit 170 reads the 
RGB image data sequentially, and performs the conversion 
on the data of each component of the RGB with reference to 
the table of the corresponding component stored in the LUT 
storing buffer 160 (Step 1006). The values of the data after 
table conversion are stored in the output image buffer 190. 

Since backlight correction largely enhances the contrast in 
the backlight portion, even noise hidden in that portion is 
enhanced as well occasionally. If this happens, an output of 
better image quality can be obtained by performing subse- 
quent treatment by the noise removing filter 180. One 
example of noise removing filter that is effective in subse- 
quent treatment is a median filter. Median filters are gener- 
ally used for removing granular noise. Noise removal by use 
of a median filter is performed as follows. First, the neigh- 
borhood of pixels is searched and a histogram of brightness 
values of the neighborhood pixels is prepared. A value that 
represents the median is obtained from the histogram, which 
is adopted as the new value of pixel. 

As described heretofore, the image processing system of 
the present invention does not correct pixels in the range 
between the brightness value 0 and the shadow region 
brightness value. Instead, it uses a tone curve that rises with 
the shadow region as its starting point, thereby achieving a 
feature that corrects halftone pixels having greater bright- 
ness value than the shadow region brightness value to a 
greater brightness. By this, this system provides the advan- 
tageous capability of correcting backlight without reducing 
contrast. 

The system is also effective in increasing the quality of 
output images by incorporating a noise removing filter. 

Although the invention has been illustrated and described 
with respect to exemplary embodiment thereof, it should be 
understood by those skilled in the art that the foregoing and 
various other changes, omissions and additions may be 
made therein and thereto, without departing from the spirit 
and scope of the present invention. Therefore, the present 
invention should not be understood as limited to the specific 
embodiment set out above but to include all possible 
embodiments which can be embodies within a scope encom- 
passed and equivalents thereof with respect to the feature set 
out in the appended claims. 
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What is claimed is: 

1. An image processing system which conducts necessary 
correction processing on digital image data, comprising: 

shadow region brightness value extracting means for 
extracting a shadow region brightness value which is a 
brightness value of a low brightness pixel from image 
data of input image; 

backlight correction amount storing means for storing a 
backlight correction amount indicative of an appropri- 
ate degree of correction on backlight input image; 

backlight correction table generating means for generat- 
ing a backlight correction table characterized by, based 
on said shadow region brightness value extracted by 
said shadow region brightness value extracting means 
and said backlight correction amount stored in said 
backlight correction amount storing means, not correct- 
ing a pixel whose brightness value falls in the range 
between "0" and said shadow region brightness value 
and correcting a pixel whose brightness value is higher 
than said shadow region brightness value so as to 
increase the brightness value; and 

LUT converting means for performing table conversion 
on image data of said input image based on said 
backlight correction table generated by said backlight 
correction table generating means to conduct color 
conversion processing of all pixels of the image data. 

2. The image processing system as set forth in claim 1, 
further comprising 

RGB brightness value converting means for calculating, 
from an RGB value of a pixel, a brightness value of the 
pixel, wherein 

said shadow region brightness value extracting means 
causes said RGB brightness value converting means 
to extract a shadow region brightness value of a 
desired low brightness pixel. 

3. The image processing system as set forth in claim 1, 
wherein 

said backlight correction table generating means compris- 
ing: 

parameter calculating means for calculating a param- 
eter for use in correction based on said backlight 
correction amount stored in said backlight correction 
amount storing means, 

first conversion table generating means for generating 
a conversion table by using said parameter calculated 
by said parameter calculating means, and 

second conversion table generating means for generat- 
ing said backlight correction table based on said 
conversion table generated by said first conversion 
table generating means and said shadow region 
brightness value extracted by said shadow region 
brightness value extracting means. 

4. The image processing system according claim 1, 
wherein 

said backlight correction table generating means compris- 
ing 

parameter calculating means for calculating a param- 
eter for use in correction based on said backlight 
correction amount stored in said backlight correction 
amount storing means, 

first conversion table generating means for generating 
a conversion table by using said parameter calculated 
by said parameter calculating means, and 

second conversion table generating means for generat- 
ing said backlight correction table based on said 
conversion table generated by said first conversion 
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table generating means and said shadow region 

brightness value extracted by said shadow region 

brightness value extracting means, 
said parameter calculating means calculating a y value 

based on said backlight correction amount, and 5 
said first conversion table generating means calculating 

a y value correction curve based on said y value. 

5. The image processing system as set forth in claim 1, 
wherein 

said backlight correction table generating means compris- 1Q 
ing: 

parameter calculating means for calculating a param- 
eter for use in correction based on said backlight 
correction amount stored in said backlight correction 
amount storing means, 

first conversion table generating means for generating 15 
a conversion table by using said parameter calculated 
by said parameter calculating means, and 

second conversion table generating means for generat- 
ing said backlight correction table based on said 
conversion table generated by said first conversion 20 
table generating means and said shadow region 
brightness value extracted by said shadow region 
brightness value extracting means, 

said parameter calculating means calculating spline 
control point coordinates based on said backlight 25 
correction amount, and 

said first conversion table generating means calculating 
a spline curve based on said spline control point 
coordinates. 

6. The image processing system as set forth in claim 1, 3Q 
wherein 

said backlight correction table generating means compris- 
ing: 

parameter calculating means for calculating a param- 
eter for use in correction based on said backlight 
correction amount stored in said backlight correction 35 
amount storing means, 

first conversion table generating means for generating 
a conversion table by using said parameter calculated 
by said parameter calculating means, and 

second conversion table generating means for generat- 4 0 
ing said backlight correction table based on said 
conversion table generated by said first conversion 
table generating means and said shadow region 
brightness value extracted by said shadow region 
brightness value extracting means, 45 

said second conversion table generating means includ- 
ing: 

backlight correction characteristics calculating 
means for calculating, with reference to a bright- 
ness value of a pixel in image data of input image, 50 
said shadow region brightness value, and said 
conversion table generated by said first conversion 
table generating means, a brightness value of the 
pixel obtained after backlight correction, and 

brightness value comparing means for comparing a 55 
brightness value of each pixel in image data of 
input image with said shadow region brightness 
value, and when the brightness value of said target 
pixel is lower than said shadow region brightness 
value, taking the brightness value of said target 60 
pixel as a brightness value to be obtained after the 
correction and when the brightness value of the 
target pixel is higher than said shadow region 
brightness value, activating said backlight correc- 
tion characteristics calculating means to calculate 65 
a brightness value to be obtained after the correc- 
tion. 
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7. A digital image data correcting method in an image 
processing system which conducts necessary correction pro- 
cessing on digital image data, comprising the steps of: 

extracting a shadow region brightness value which is a 

brightness value of a low brightness pixel from image 

data of input image; 
obtaining a backlight correction amount indicative of an 

appropriate degree of correction on backlight input 

image; 

generating a backlight correction table characterized by, 
based on said shadow region brightness value extracted 
at said shadow region brightness value extracting step 
and said backlight correction amount obtained at said 
backlight correction amount obtaining step, not cor- 
recting a pixel whose brightness value falls in the range 
between "0" and said shadow region brightness value 
and correcting a pixel whose brightness value is higher 
than said shadow region brightness value so as to 
increase the brightness value; and 

performing table conversion on image data of said input 
image based on said backlight correction table gener- 
ated at said backlight correction table generating step to 
conduct color conversion processing of all the pixels of 
the image data. 

8. The image processing system as set forth in claim 7, 
wherein 

said backlight correction table generating step comprises 
the steps of: 

calculating a parameter for use in correction based on 
said backlight correction amount stored in said back- 
light correction amount storing means, 

generating a conversion table by using said parameter 
calculated at said parameter calculating step, and 

generating said backlight correction table based on said 
conversion table generated at said conversion table 
generating step and said shadow region brightness 
value extracted by said shadow region brightness 
value extracting means. 

9. The image processing system as set forth in claim 7, 
wherein 

said backlight correction table generating step comprises 
the steps of: 

calculating a parameter for use in correction based on 
said backlight correction amount stored in said back- 
light correction amount storing means, 
generating a conversion table by using said parameter 

calculated at said parameter calculating step, and 
generating said backlight correction table based on said 
conversion table generated at said conversion table 
generating step and said shadow region brightness 
value extracted by said shadow region brightness 
value extracting means, 
said step of generating a backlight correction table 
based on said conversion table including the steps of: 
comparing a brightness value of each pixel in image 
data of input image with said shadow region 
brightness value, 
determining a brightness value of said target pixel as 
a brightness value to be obtained after the correc- 
tion when the brightness value of said target pixel 
is lower than said shadow region brightness value, 
and 

calculating a brightness value of a target pixel to be 
obtained after the backlight correction with refer- 
ence to the brightness value of said target pixel, 
said shadow region brightness value, and said 
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conversion table generated at said conversion 
table generating step when the brightness value of 
said target pixel is higher than said shadow region 
brightness value. 

10. A computer readable memory which stores an image 5 
processing program for controlling an image processing 
system which conducts necessary correction processing on 
digital image data, said image processing program compris- 
ing the steps of: 

extracting a shadow region brightness value which is a 10 

brightness value of a low brightness pixel from image 

data of input image; 
obtaining a backlight correction amount indicative of an 

appropriate degree of correction on backlight input 

image; 

generating a backlight correction table characterized by, 
based on said shadow region brightness value extracted 
at said shadow region brightness value extracting step 
and said backlight correction amount obtained at said 
backlight correction amount obtaining step, not cor- 
recting a pixel whose brightness value falls in the range 
between "0" and said shadow region brightness value 
and correcting a pixel whose brightness value is higher 
than said shadow region brightness value so as to 
increase the brightness value; and 

performing table conversion on image data of said input 
image based on said backlight correction table gener- 
ated at said backlight correction table generating step to 
conduct color conversion processing of all the pixels of 30 
the image data. 

11. The computer readable memory as set forth in claim 
10, wherein 

said backlight correction table generating step of said 
image processing program comprises the steps of: 
calculating a parameter for use in correction based on 
said backlight correction amount stored in said back- 
light correction amount storing means, 
generating a conversion table by using said parameter 
calculated at said parameter calculating step, and 
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generating said backlight correction table based on said 
conversion table generated at said conversion table 
generating step and said shadow region brightness 
value extracted by said shadow region brightness 
value extracting means. 
12. The computer readable memory as set forth in claim 
10, wherein 

said backlight correction table generating step of said 
image processing program comprises the steps of: 
calculating a parameter for use in correction based on 
said backlight correction amount stored in said back- 
light correction amount storing means, 
generating a conversion table by using said parameter 

calculated at said parameter calculating step, and 
generating said backlight correction table based on said 
conversion table generated at said conversion table 
generating step and said shadow region brightness 
value extracted by said shadow region brightness 
value extracting means, 
said step of generating a backlight correction table 
based on said conversion table including the steps of: 
comparing a brightness value of each pixel in image 
data of input image with said shadow region 
brightness value, 
determining a brightness value of said target pixel as 
a brightness value to be obtained after the correc- 
tion when the brightness value of said target pixel 
is lower than said shadow region brightness value, 
and 

calculating a brightness value of a target pixel to be 
obtained after the backlight correction with refer- 
ence to the brightness value of said target pixel, 
said shadow region brightness value, and said 
conversion table generated at said conversion 
table generating step when the brightness value of 
said target pixel is higher than said shadow region 
brightness value. 
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